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The  methods  at\d  approaches  introduced  so  far  for  estimating, 
the  operating  characteristics  of  item  response  categories  require 
the  Old  Teat,  or  a set  of  items  whose  operating  characteristics  are 
known.  To  generalize  these  methods  to  apply  for  the  situation 
where  we  start  to  develop  a new  item  pool,  i.e.,  there  is  no  "Old  Test," 
an  approach  is  made  by  assuming  that  the  tentative  item  pool  has  a 
substantial  number  of  equivalent  items,  even  though  their  common  item 
characteristic  function  is  not  known  yet.  It  is  observed  that, 
within  the  type  of  item  characteristic  function  which  is  strictly 
increasing  in  the  latent  trait  6 with  zero  And  unity  as  its  two 
asymptotes,  the  area  nnder  the  square  root  of  the  item  information 
function  is  a constant  value,  it  . The  item  characteristic  function 
which  provides  a constant  item  information  is  searched  and  discovered, 
and  is  named  the  constant  information  model.  Using  this  model,  it 
is  observed  that  the  subset  of  equivalent  binary  items  can  be  used 
as  a substitute  for  the  Old  Test,  and  these  methods  and  approaches 
are  generalized  in  the  present  situation.  It  is  discovered  that,  for 
once,  items  with  low  discrimination  power  have  a significant  role. 
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FUNCTION 

ABSTRACT 

'*»  The  methods  and  approaches  Introduced  so  far  for  estimating 
the  operating  characteristics  of  item  response  categories  require 
the  Old  Test,  or  a set  of  items,  whose  operating  characteristics  are 
known.  To  generalize  these  methods  to  apply  for  the  situation 
where  we  start  to  develop  a new  item  pool,  i.e.,  there  is  no  *01d  Test,* 
an  approach  is  made  by  assuming  that  the  tentative  item  pool  has  a 
substantial  number  of  equivalent  items,  even  though  their  common  item 
characteristic  function  is  not  known  yet.  It  is  observed  that, 
within  the  type  of  item  characteristic  function  which  is  strictly 
Increasing  in  the  latent  trait,  6 with  zero  and  unity  as  its  two 
asymptotes,  the  area  under  the  square  root  of  the  item  Information 
function  is  a constant  value,  tt  . The  item  characteristic  function 
which  provides  a constant  item  information  is  searched  and  discovered, 
and  is  named  the  constant  information  model.  Using  this  model,  it 
is  observed  that  the  subset  of  equivalent  binary  items  can  be  used 
as  a substitute  for  the  Old  Test,  and  those  methods  and  approaches 
are  generalized  in  the  present  situation.  It  is  discovered  that,  for 
once,  items  with  low  discrimination  power  have  a significant  role. 
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I Introduction 


Estimation  of  the  operating  characteristics  of  the  item 
response  cstegories  of  s test  item  has  been  investigated  (Samejlma, 
1977b,  1977d , 1978a,  1978b,  1978c,  1978d,  1978e)  without  assuming 
any  prior  mathematical  forma,  and  by  using  a relatively  small  number 
of  examinees  in  the  process  of  estimation.  One  common  restriction 
in  these  methods  and  approaches  presented  so  far  is  that  we  need  the 
Old  Test  (cf.  Appendix  I)  consisting  of  the  items  whose  operating 
characteristics  are  known,  and  which  provides  us  with  a constant  test 
information  function  for  the  Interval  of  latent  trait,  or  ability, 

6 of  our  Interest.  With  this  setting,  each  examinee's  ability 
level  is  estimated  from  his  response  pattern  by  the  maximum  likelihood 
estimation,  and  the  set  of  these  maximum  likelihood  estimates  is 
the  main  information  source  of  the  estimation  procedures.  The 
methods  are  useful,  therefore,  in  such  a situation  that  we  already 
have  an  item  pool,  and  we  wish  to. .add.  more  items  to  it. 

A question  arises  as  to  whether  it**ffi  possible  to  overcome 
this  restriction,  and  to  make  these  methods  and  approaches  useful 
in  a more  general  situation,  in  which  there  is  no  Old  Test,  and, 
consequently,  the  maximum  likelihood  estimate  of  each  examinee's 
ability  is  not  a priori  given.  The  fact  is  that  it  is  not  difficult 
to  do  so,  if  we  are  in  such  a situation  that  a large  number  of  test 
items  are  administered  to  the  group  of  examinees,  which  Include  a 
set,  or  sets,  of  equivalent  items,  i.e.,  the  items  whose  operating 
characteristics  are  identical.  In  practice,  we  need  to  identify 
these  equivalent  items  without  knowing  their  operating  characteristics, 
and  in  so  doing  several  conditions  should  be  satisfied. 
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In  Che  present  paper,  theory  and  rationale  behind  the  process 
of  generalising  the  estiaatlon  net hods  in  the  above  situation  will 
be  presented  and  discussed,  leaving  the  Monte  Carlo  study  to  observe 
tha  actual  process  and  results  to  a later  paper.  Since,  in  practice, 
■any  researchers  and  testers  use  binary  items  in  both  tailored  testing 
and  papar-and-pendl  testing,  hera  ve  solely  use  binary  items,  although 
graded  items  are  more  informative  and  efficient  to  use  (Samejima, 

1969,  1977a,  1977c,  1977e).  This  restriction  will  give  us  a 
practical  advantage,  however,  since  it  is  much  less  likely  that 
we  find  a subset  of  graded  items,  each  of  which  has  the  same  number  of 
item  response  categories  with  the  same  set  of  operating  characteristics 
as  each  other,  among  the  test  items  in  an  actual  test  or  a tentative 
item  pool. 
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II  Some  Properties  of  the  Information  Functions 

Throughout  this  paper,  we  only  deal  with  the  unl^dlmenslonal 
latent  space.  The  range  of  the  latent  trait  0 Is  not  necessarily 
the  set  of  all  real  numbers,  however,  as  will  be  exemplified  later 
in  following  sections. 

Lat  x be  the  graded  item  score,  or  graded  response  category, 

g 

of  Item  g , which  assumes  integers,  0 through  m , and  P (0) 

g xg 

be  its  operating  characteristic,  or  the  conditional  probability,  given 
ability  0 , that  the  examinee’s  response  to  item  g falls  into 
category  x . The  item  response  Information  function  (Samejima, 

1969),  I (0)  , is  defined  by 

*g 

(2.1)  Ix  (6)  - - log  Px  (0)  . 

g g 

The  item  Information  function.  I (0)  , is  the  conditional  expectation 
g 

of  the  item  response  information  function,  given  0 , so  that 

m 

(2.2)  I (0)  - E[Ix  (0) | 0 ] - I8  I (0)  Px  (0) 

8 g xg-0  g g 

- ”8  Px  <0)]2  [Px  wf1 

V°  8 8 

(cf.  Samejima,  1969,  Chapter  6).  Let  Py(0)  be  the  operating 
characteristic  of  the  response  pattern  V . By  virtue  of  the  local 
independence  (Lord  and  Novick,  1968,  Chapter  16,  Samejima,  1969), 
this  operating  characteristic  is  the  product  of  the  operating 
characteristics  of  the  participating  Item  response  categoric*,  l.e., 


V©) 


n p (0)  . 

Yv  * 


(2.3) 


The  response  pattern  Information  function,  Iy(6)  » w''lch  la  defined 
for  every  possible  response  pattern  of  a test,  or  a set  of  n Items, 
can  be  written  for  a specified  response  pattern  V such  that 

(2.4)  Iv(0)  - - log  Pv(9)  -El  <9)  . 

V dt)  v , eV  x# 

The  teat  information  function.  1(0)  , la  daflnad  aa  tha  conditional 
expectation,  given  0 , of  the  rasponae  pattern  Information  function, 
and  after  acme  manipulations  we  can  write 

n 

(2,1)  1(0)  - E Iw(0)  Pw(0)  - E 1(0)  . 

V V V * 

Suppoae  we  are  in  the  position  to  transform  the  ability  scale 
0 to  another,  by  a strictly  Increasing  function  auch  that 

(2.6)  T - T (0)  , 


We  can  easily  see  from  the  definitions  of  the  operating  characteristics 
that  they  are  unchanged,  or 


(2,7) 


and 


(2.8) 


PJ  (T)  " P*  (0) 

> 8 


P$(t)  " Pv(6)  . 


Tha  Information  functions  change,  however,  and  we  obtain  the  following, 
i;  (t)  ■ i,  <8)  i-g]2  - -&■  log  p,  <8).-i£  . 


I 


(2.9) 


d*0 

dF 
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(2.10)  IJ(T)  - lg(9)  l^g-J2  . 

(2.11)  ly (t)  - Iy(6)  [^f-]2  - -fa  log  Py(0)-0-  • 

(2.12)  I*(T)  - 1(0)  l-^-}2  . 


The  above  results  come  from  the  relationship,  which  is  directly 
derived  from  (2.7).  such  that 


(2.13) 


3 Pi  (t)  - -fa  p„  (0)  de 


3t  x 


dr 


g g 

and  the  definition  of  the  item  response  information  function,  and  those 
of  the  other  three  types  of  information  functions.  It  should  be  noted 
that  the  area  under  the  curve  of  the  item  information  function,  and 
that  of  the  test  information  function,  do  change  with  the  transformation 
of  the  ability  scale,  since  we  have  the  relationships 


(2.14) 


and 


(2.15) 


/; 


I*(x)  dt 


/: 


| T I*(t)  dT  - 


Ig(0)  “d?"  d0 


1(e)  -g  d9 


where  0 and  0 are  the  lower  and  upper  endpoints  of  the  range  of  Q 
and 


(2.16) 


I ’ T<0> 
T “ T(0) 


are  those  of  the  range  of  the  transformed  variable  T . If  we  integrate 
the  square  root  of  each  of  the  two  information  functions,  however, 


rw  r 
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we  obtain 


(2.17) 


Ui(T)J1/2  dr  - 


[ i_ (0) ) 1/2  de  , 


(2.18) 


[I*(T)]1/2  dx  - 


(1(0)] 2/2  d0  . 


Thus  the  area  under  the  curve  of  the  square  root  of  the  Item 


information  function,  and  that  of  the  test  information  function,  are 


unchanged  throughout  the  transformation  of  the  latent  trait  by 


any  strictly  increasing  function,  x(0)  . This  fact  has  many 


important  Implications,  as  will  be  described  in  the  next  section. 


On  the  dichotomous  response  level  (Samejima,  1972),  which 


is  considered  as  a special  case  of  the  graded  response  level  with 


m^  ■ 1 for  each  item  g , the  item  information  function  is  simplified 


to  the  form 


(2.19) 


Ig(6)  " I_^_Pg(8)]2  lPg(0)  Qg(0)]1  * 


where  P (6)  is  the  item  characteristic  function,  defined  by 
8 


(2.20) 


P (0)  - prob,[u  -l|0] 

© O 


with  u (“0,1)  denoting  the  binary  item  score,  and 
8 


(2.21) 


Q (0)  ■ prob,[u  —0 | 0 ] - 1 *-  P (0)  • 

8 8 8 


(2.19)  is  derived  directly  from  (2,2),  and  also  is  equal  to  the  i em 
Information  function  used  by  Birnbaum  (Blrnbaum,  1968) , 


L 
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It  should  be  noted  that,  by  definition,  the  item  information 
function  is  non-negative,  regardless  of  the  values  of  the  item 
response  information  functions,  as  is  clear  from  (2,2)  and  (2,19), 

When  we  consider  this  function  as  a measure  of  the  local  accuracy  of  the 
estimation  of  ability  9 , however,  the  function  will  be  meaningless 
and  misleading,  if  for  some  range  of  G one,  or  more,  of  the  item 
response  information  functions  assumes  negative  values.  This 
happens  to  the  three  parameter  models , i.e, , 


(2.22) 


Ve)  * cg + (1  - V Y9) 


where  c is  the  guessing  parameter  and  4*  (0)  is  some  strictly 
8 8 

increasing  function  of  0 with  0 and  1 as  its  two  asymptotes. 

The  three-parameter  normal  ogive  model  and  the  three-parameter  logistic 

model  (Birnbaum,  1968)  are  two  typical  examples  of  (2.22),  As  was 

pointed  out  before  (Samejima,  1972,  1973),  any  item  characteristic 

function  formulated  by  (2.22)  has  some  range  of  0 in  which  the 

item  response  information  function  for  the  item  score  1 assumes 

negative  values,  and,  therefore,  the  unique  local  maximum  is  not 

assured  for  every  possible  response  pattern,  provided  that  V (0) 

8 

satisfies  the  unique  maximum  condition  (Samejima,  1969,  1972), 
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III  Some  Implications  of  the  Constancy  of  the  Totality  of  the  Square 
Root  of  Item  Information  Function  under  the  Transformation 
of  the  Latent  Trait 

It  can  be  observed  easily  that  any  specified  item  characteristic 
function  can  be  transformed  to  another,  which  belongs  to  the  same 
model,  through  the  transformation  of  the  latent  trait.  To  give 
an  example,  suppose  that  item  g has  an  item  characteristic  function 
in  the  normal  ogive  model,  such  that 


(3.1) 


Pg(6)  - [ 2tt I 


1/o  l ® (6”b  ) 2 

-1/2  I g g exp[-t/2 ] dt  . 


/: 


To  change  this  to  another  item  characteristic  function  which  also 
follows  the  normal  ogive  model  but  with  different  item  discrimination 
and  difficulty  parameters,  a*  and  b*  , all  we  need  is  such  a 
linear  transformation  of  d to  z that 


(3.2) 


T - a (0  - b)  a*"1  + b*  . 
g g g g 


Thus  we  can  write  for  the  resultant  item  characteristic  function 


p;(t) 


(3.3) 


-1/2  2 

P*(t)  - [2ir]  1/4  J 8 g exp[-t  /2 ] dt  . 

/ —00 


An  important  implication  of  this  fact,  combined  with  (2,17),  is  that 
the  area  under  the  curve  of  the  square  root  of  the  item  information 
function  is  constant  for  every  item  characteristic  function  which 
belongs  to  the  same  model.  For  the  purpose  of  illustration.  Figures 
3-1  and  3-2  present  the  item  information  functions  and  their  square 
roots  for  three  items,  all  of  which  belong  to  the  normal  ogive  model 
with  a1  - 1.0,  a2  - 2.0  and  a3  - 3.0  , and  bx  “ b2  * b3  “ °'°  • 


0.0 
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reapectively . We  can  see  that  in  Figure  3 -1  the  three  areas  are 
substantially  different  from  one  another,  just  like  the  case  of 
the  logistic  model  with  the  same  parameter  values  (cf,  Birnbaum, 
page  461,  Figure  20.4.1).  On  the  other  hand,  in  Figure  3-2,  these 
areas  under  the  three  curves  are  the  same,  just  as  was  expected. 

This  fact  can  be  generalized  further,  to  include  item 
characteristic  functions  of  different  models.  Suppose  that  item  g 
has  some  strictly  increasing  item  characteristic  function,  with 


(3.4) 


f lim 

) o-*e 


pg(0) 


P 

0->0  c 


(0) 


0 

1 . 


We  can  see  that,  regardless  of  the  model  tc  which  Pg(0)  belongs, 

it  can  be  transformed  to  any  other  item  characteristic  function* 

which  is  strictly  increasing  and  has  the  two  asymptotes,  0 and  1 , 

through  the  transformation  of  the  latent  trait  P to  x , To  be 

more  precise,  it  should  be  noted  that,  for  any  pair  of  models  which 

belong  to  the  type  described  above,  and  provide  us  with  the  item 

characteristic  functions  P (0)  and  P*(0)  respectively,  there  is  one 

8 8 

and  only  one  pair  of  values  of  0 which  corresponds  to  any  specific 
value  of  probability  between  zero  and  unity  exclusive.  Let  us  call 
the  second  value  of  0 x , and  consider  it  as  a function  of  the 
first  value  of  0 . Thus  we  have 


(3.5)  T - x(0)  . 


Since  both  P (0)  and  P*(0)  are  strictly  increasing  in  0 , the 
8 8 

functional  relationship  in  (3.5)  must  be  strictly  Increasing,  and. 
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therefore,  we  can  also  write 


(3.6) 


e - 0(T)  , 


which  Is  also  a strictly  Increasing  function  of  T . Thus  we  have 


(3.7) 


r Pg<e>  “ P 

t p*g(T)  - p 


- PJlx(6)] 


,[0(T)]  . 


The  general  form  of  the  transformation  of  0 to  T Is,  therefore, 


(3.8) 


T“Pg  [Y0)1  ’ 


and  that  of  t to  0 is 


(3.9) 


e - p„  [p;(t)i  . 

g g 


For  the  purpose  of  illustration,  let  us  consider  two  binary 


items,  one  of  which  has  a linear  item  characteristic  function  such 


(3.10) 


pg(e)  - <e-wv 


a < 0 < 6 , 

g g 


and  tha  other  has  an  item  characteristic  function  in  the  logistic 
model,  such  that 


(3.11) 


Ph(0)  - (1  + exp{-Dah(0  - bb))]'1  < 0 < » , 


where  a^  is  the  discrimination  parameter,  is  the  difficulty 

parameter,  and  D ie  the  scaling  factor.  It  is  well  known  that 
(3.11)  very  close  to  tha  Item  charactarietlc  function  in  the 
normal  ogive  model  of  the  same  parameter  values,  if  we  set  D - 1.7 
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(Blrnbaum,  1968).  These  two  item  characteristic  functions  are 
illustrated  in  Figure  3-3,  with  a --2.5  and  6-2.5  for  item  g , 
and  with  D - 1.7,  ah  - 1.0  and  bh  - 0.0  for  itaa  h . 

Suppose  that  our  original  item  characteristic  function  is  linear, 
as  is  defined  by  (3.10).  We  shall  try  to  transform  6 to  T so 
that  the  resultant  item  characteristic  function  is  written  as 


(3.12) 


P*(t)  - [1  + exp{-Da  (t  - b )}J 
g g g 


-1 


r 


the  identical  form  as  (3.11).  Since  we  have  from  (3.7),  (3.10)  and 

(3.12) 

(3.13)  (0-a)(6  -d)  1 - [1  + exp{-Da  (T-b  )}]  1 , 

g g g g g 

a direct  expansion  of  the  above  provides  us  with 

(3.14)  T - (Da  )-1  log  [(0  - a)  (ft  - 0)"1]  + b . 

© o o o 

Figure  3-4  presents  the  relationship  between  the  original 

latent  trait  0 and  the  transformed  latent  trait  T with  a = -2.5, 

g 

- 2.5>,  D - 1,7,  a -1,0  and  b - 0.0  . 

8 g g 

If  the  situation  is  reversed,  and  the  transformation  is  from 
T to  0 , then  we  obtain  in  the  same  way 

(3.15)  0 - [6  + a exp{-Da  (T  -b  )}][1  + exp(-Da  (T-b  )}]_1 

8 & 8 § OO 

• “g + (6g ' V PJ(T)  ■ 

It  is  obvious  that  the  range  of  0 resulting  from  the  above  trans- 
formation is 


(3.16) 


a < 0 < 0 

g g 


Item  h (Solid  Curve),  Follows  the  Logistic  Model  with  D * 1.7,  = 

and  = 0.0  . For  Comparison,  the  Item  Characteristic  Function  of 

an  Item  Following  the  Normal  Ogive  Model  with  the  Same  Parameters  as 
Item  h Is  Also  Drawn  by  a Dotted  Curve. 


FIGURE  3-4 

Functional  Relationship  between  the  Original  Latent  Trait  0 and 
the  Transformed  Latent  Trait  r , When  the  Transformation  Is 
Made  by  Formula  (3.14),  with  a - -2.5,  0 - 2.5,  D - 1.7, 

a * 1.0  and  b ■ 0.0. 
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The  above  fact  Implies  that  the  area  under  the  curve  of  the 
square  root  of  the  item  information  function  derived  from  any  item 
characteristic  function,  which  is  strictly  increasing  In  0 and 
satisfies  (3,4) , jls  constant,  regardless  of  the  model  to  which 
At  belongs.  As  we  have  seen  in  the  above  example,  it  does  not  matter 
if  the  range  of  the  latent  trait  is  a finite  interval,  the  set  of 
all  real  numbers,  or  something  else. 

For  the  purpose  of  illustration,  we  shall  go  back  to  the 
example  we  used  earlier,  i.e.,  that  of  the  linear  model  and  the 
logistic  model,  whose  item  characteristic  functions  are  given  by 
(3.10)  and  (3.12),  respectively.  We  can  write  from  (2.21),  (3.10) 
and  (3.12) 

(3.17)  Q (0)  - (8  - 0)(6  - a r1 

• B 5 o 

and 

(3.18)  Q*(x)  ■ [1  + exp (Da  (x-b  )}]_i  . 

© 8 8 

We  can  also  write  for  the  derivatives  of  the  two  item  characteristic 
functions  such  that 


(3.19) 


-£r  p.<e>  • <e„  - O"1. 

36  * 8 g ' 


and 


(3.20)  P*(T)  - Da  exp{-Da  (x-b  ) } [1  + exp{-Da  (x-b  )}]“2 


8 8 r 8'  g 

- % PJ(x)  Q*(x)  . 


8 g 


Thus  the  item  information  function,  Ig(0)  , in  the  linear  model 
is  given  by 
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(3.21)  Ig(0)  - [(0  -a)(eg-  0)] 


We  can  also  write  for  the  item  information  function 
transformation  of  the  latent  trait  0 to  t 


I*(t) 

g 


after  the 


(3.22) 


I*(t)  - D2  ag2  P*(t)  Q£(t) 

2 2 

- D ag  exp[-Dag(T-bg)Hl  + exp{  r-Dag(T-bg) } ]"2 

" 1)2  ag2  pg(e)  Qg (e) 

■ 1)2  ag2(e  - V(6g  - 6)(8g  - v’2  • 


The  two  item  information  functions  given  by  (3.21)  and  (3.22)  with 
the  same  set  of  item  parameters  and  a scaling  factor  are  shown  in 
Figure  3-5,  and  their  square  roots  are  presented  as  Figure  3-6. 

It  is  interesting  to  note  that,  within  each  figure,  the  two  curves 
are  substantially  different. 

It  can  be  observed  easily  that  the  constancy  of  the  area  under  the 
curve  of  the  square  root  of  the  item  information  function  holds  for 

the  set  of  item  characteristic  functions  which  take  the  form  given 
by  (2.22),  if  the  value  of  cg  is  common.  The  meaningfulness  of 
the  item  information  function  is,  however,  doubtful  for  this  type 
of  item  characteristic  function,  as  was  pointed  out  earlier,  so  we 
will  not  pursue  this  type  in  the  present  paper. 
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Model  with  j - -2.5  and  £ - 2.5  (Dashed  Curve),  and  That  of  Item  h , Which 

g g 

Follows  the  Logistic  Model  with  D « 1.7,  a^  ■ 1.0  and  * 0.0  (Solid  Curve). 

For  Comparison , the  Square  Root  of  the  Item  Information  Function  of  an  Item, 
Which  Follows  the  Normal  Ogive  Model  with  the  Same  Parameters  as  Item  h , 

I s Drawn  by  a Dotted  Curve. 
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IV  Area  under  the  Curve  of  the 
Function 

We  have  seen  that  the  area  under  the  curve  of  the  square  root 
of  the  Item  Information  function  derived  from  any  Item  characteristic 
function,  which  Is  strictly  increasing  in  0 and  whose  two  asymptotes 
are  0 and  1 , respectively,  is  constant.  Note  that  not  only  the  square 
roots  of  the  item  information  functions  in  the  linear  and  logistic  models  In 
Figure  3-6  but  those  in  the  normal  ogive  model  in  Figure  3-2  exemplify 
this  constant  area.  Now  the  question  is:  What  Is  the  value  of  this 
area?  We  notice  that  this  can  be  obtained  by  integrating  any  one 
of  these  curves,  or  any  other  curve  which  is  derived  from  an  item 
characteristic  function  of  the  same  type,  regardless  of  the  model  to 
which  it  belongs.  To  make  the  mathematical  process  simpler,  we 
shall  take  up  the  simplest  model,  i.e.,  the  linear  model. 

We  can  write  from  (3.21)  that^ 

(4.1)  (tl  (8)]1/2  de  - f6  [(9  - a)  (6  - 0)f1/2  d0  . 

J a 8 /a 

Let  us  define  a new  variable  0*  such  that 

(4.2)  0*  - [20  - (a  + 8)][e  - a]"1  . 

Then  we  obtain 


Square  Root  of  the  Item  Information 


(4.3)  0 - [ (6  - a)0*  + (o  + 6)]/2  , 


(*•«)  -j®r  - <s  - «>/2 

and 

(4.5)  -1  < 0*  < 1 . 


§ Since  we  deal  only  with  one  item  in  this  section  and  in  Section  5, 


for  simplicity,  we  use  o and  8 in  place  of 


o 


and  $ 


g 
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Using  this  new  variable  0*  , (4,1)  can  be  rewritten  as 

j’  [ (6  - a)/?]"1  (1  r d*2)~1/2 


(4,6) 


/: 


Ug(e)]1/2  do 


i: 


[(6  r a)/2]  d6* 


(1  - 0*2)"1/2  d0* 


- sin  ^0* 


1 

-1 


Thus  we  have  found  out  that  the  area  under  the  curve  of  the  square 
root  of  the  item  information  function,  which  ^Ls  derived  from  any 
strictly  increasing  item  characteristic  function  with  0 and  1 as 
its  two  asymptotoes . is  tt 

The  same  result  can  be  obtained  just  as  easily,  if  we  use  the 
logistic  model  instead  of  the  linear  model.  We  can  write  from  (3.22) 


(4.7) 


!- 


[ I*(T) ) 1/2  dl  - Da  f [exp (Da  (T-b  )}]1/2 
g g J_oo  8 8 


[1  + exp{Da  (T-b  )}[  ^ dT  . 
g g 


Defining  x*  such  that 
(4.8) 

we  obtain 


X*  - [exp{Da  (T-b  )}] 

o o 


1/2 


(4’9)  * 2 ^g)"1  * 


and,  substituting  this  result  into  (4.7),  we  can  write 
(4.10) 


/: 


I: 


[I*(x)]1/2  dx  - Da  f T*(l+x*2)-1  2 (Da  )_1t*  1 dx* 

8 &)  0 8 


(1  + X*2)"1  dx*  * 2 tan  "x* 


-1 


0 
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V Search  for  the  Item  Characteristic  Function  Which  Provides  a 
■ ■ 1 ■ ■ ' !.-»■  v~  r » T v.1  - 1 « \ » y ' ' r v '■  v i ■ > rrrrt-  -^rTTrrc  — 

Constant  Item  Information  Function 


rrrTTTTTT-t  - 


We  are  to  find  out  the  model  for  the  item  characteristic 
functions  which  provide  us  with  constant  item  information  functions, 
within  the  type  of  item  characteristic  function  which  is  strictly 
increasing  in  6 with  0 and  1 as  its  lower  and  upper  asymptotes. 
It  is  observed  from  (2,19)  that  such  a model  is  unique,  since  the 
derivative  of  the  item  characteristic  function  is  non»-negative  for 
any  model  which  belongs  to  this  type,  and  it  is  up  to  the  numerator 
of  the  right  hand  side  of  (2,19)  to  make  the  item  information  function 
constant.  It  is  also  observed  that  the  range  of  0 for  such  an 
item  characteristic  function  is  a finite  interval,  since  the  area 
under  the  square  root  of  the  item  information  function  is  a finite 
value,  tt  , as  was  found  out  in  the  preceding  section. 

Let  C be  this  constant  amount  of  item  Information  for 
0 < 0 < 0 . Then  we  have 


(5.1) 


0 - 0 - ttC 


-1/2 


Thus  the  length  of  the  interval  of  0 depends  upon  the  constant 
item  information  C . 

We  find  that  the  model  described  by 


(5.2) 


P (0)  - sin  [a  (0  - b ) + (it/4)  ] 

o o © 


is  the  one  we  have  looked  for,  if  we  set  the  parameter  a such  that 

8 


(5.3) 


- cmn  . 


with  the  range  of  0 such  that 
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(5.4)  [-na  -1/4]  + b < 9 < ha  -1/4]  + b 

S B 8 8 

To  confirm  this,  we  can  write  from  (5,2)  and  (5,3) 

(5-5)  Q (0)  “ cos2[a  (0  - b ) + (it/4)  ] , 

6 o 6 

and 

(5.6)  P (0)  - 2 sin  [a  (0  - b ) + (tt/4)  ] • 

do  g 8 8 

cos  [a  (0  - b ) + (tt/4)]  • a 
8 8 8 

- 2 ag  iye>Qg<e>)1/2 

- C1/2  [P  (0)Q  (0)]1/2  , 

o 5 

and  substituting  (5.2),  (5,5)  and  (5.6)  Into  (2.19)  we  obtain 

(5.7)  Ig(0)  - C . 


We  can  see  from  (5.2)  that  this  model  provides  us  with  point 

symmetric  item  characteristic  functions  with  (b  , 0.5)  as  the  point 

8 

of  symmetry,  just  like  the  normal  ogive  model,  the  logistic  model 

and  the  linear  model.  The  parameter  bg  can  be  called,  therefore, 

difficulty  parameter.  Just  as  in  the  normal  ogive  and  logistic  models. 

It  is  obvious  from  (5.6)  that  the  parameter  ag  is  (proportional  to) 

the  slope  of  the  line  tangent  to  P (0)  at  0 ■ b , Just  as  in 

8 8 

these  two  models,  so  it  can  be  called  discrimination  parameter. 

The  meaning  of  this  parameter  is  more  obvious  in  (5.3),  i.e.,  the 
fact  that  the  amount  of  item  information  solely  depends  upon  the 
parameter  ag  . 
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We  shall  call  this  model,  which  la  presented  by  (5,2),  the 
constant  Information  model.  This  model  has  an  Important  role  In 
the  estimation  of  the  operating  characteristics  of  item  response 
categories,  which  will  be  described  in  the  following  section. 

It  should  be  noted  that  this  model  can  be  derived  from 
any  other  model  of  the  present  type,  such  as  the  normal  ogive, 
logistic  and  linear  models,  by  an  appropriate  transformation  of 
the  latent  trait.  For  the  purpose  of  illustration,  we  shall 
follow  the  process  starting  from  the  linear  model,  which  is  given 
by  (3.10)  . Let  us  define  a new  variable  0**  such  that 

(5.8)  0**  - (6  - a) (0  - a)"1  . 

From  (5.8)  we  obtain  for  the  item  characteristic  function 


(5.9) 

p**(0**)  . 0** 
8 

» 

and  then 

(5.10) 

Q**(0**)  1 1 _ 

0** 

(5.11) 

86.*  T9**’ 

- 1 

and 

(5.12) 

0 < 0**  < 1 . 

Then  the  item  Information  function  is  derived  from  (5.9),  (5.10), 
(5.11)  and  (2.19)  such  that 


(5.13) 


i**(e**)  - [e**(i  - e**)] 


Using  the  relationship 


(5.14)  IJ(-r)  - l£*(0**)  t 

and  setting 

(5.15)  I*(l)  - C , 

we  obtain 

(5.16)  -Jlbr-  - o**)f1/2  . 

From  (5.16),  we  can  write 

(5.17)  T - (C)'1/2  J[6**(l  - 0**)]"1/2  dfl**  + dL, 

where  d^  is  an  arbitrary  constant.  Let  us  define  a variable  A such 

that 

(5.18)  a - e**1/2 

Then  we  have 

(5.19)  0**  - A2  , 

(5.20)  - 2A 

and 

(5.21)  0 < A < 1 • 

Using  (5.19),  (5.20)  and  (5.21),  the  integral  in  the  right  hand  side 
of  (5.17)  can  be  rewritten  as 
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(5.22)  J (0**(1  - 0**)]"1/2  d0**  - 2 J [1  - X*r1/2  dX  + d2 

■ 2 sin  A + dj 
- 2 sin_1(0**)1/2  + d3  , 

where  d3  is  an  arbitrary  constant.  Substituting  (5.22)  into  (5.17), 
we  obtain 

(5.23)  i - 2(C)-1/2  sin-1(0**)1/2  + d4  , 
where  d4  is  an  arbitrary  constant,  and  then 

(5.24)  0**  - sin2((C)1/2(x  - dA)/2]  . 

We  can  write  from  (5.9)  and  (5.24) 

(5.25)  P*(T)  - P**(0*)  - sln2[(C)1/2(T  - d4)/2]  . 

Defining  the  parameter  aR  by  (5.3)  and  setting 

(5.26)  - b - ttc"1/2/2  , 

g 

we  obtain  (5.2)  and  (5.4). 

Figure  5-1  presents  a few  examples  of  the  item  characteristic 
function  of  the  constant  Information  model,  together  with  the 
corresponding  item  information  functions. 


i 
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-3.1416  -2.2854  -1.0708  0.1073  0.8927  2.0708  3.0472 

-0.7146  0.9528  3-1A1 

FIGURE  5-1 


Item  Characteristic  Functions  (Upper  Graph)  and  the  Item  Information  Functions 
(Lower  Graph)  of  Five  Binary  Items  Following  the  Constant  Information  Model. 
The  Item  Parameters  Are:  a^  - 0.25  and  bj  - 0.00  (Smaller  Dots), 

82  “ 0.50  and  b2  “ 0.50  (Shorter  Dashes),  a(  - 0.75  and 

b^  • 2.00  (Larger  DoIh),  a,  * 1.0  and  b,(  - -1.5  (Longer 

Itaalimal,  and  nt  - 7.00  and  h,(  - O.'dl  (Solid  Line). 
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VI  Characteristics  the  Constant  Information  Model 

Here,  we  shall  stop  and  consider  some  Important  characteristics 

of  the  constant  information  model,  which  is  given  by  (5.2),  in  addition 

2 

to  the  fact  that  its  item  information  function  Is  constant,  i.e,,  4a 

8 

The  basic  function  (Samejima,  1969),  A_  (6)  , which  has  an  important 

Xg 

role  in  the  computerization  of  the  process  of  maximum  likelihood 
estimation  and  so  on  when  the  minimal  sufficient  statistic  does  not 
exist,  is  defined  for  the  graded  response  category  xg  such  that 


(6.1) 


\ (9)  ’ IT  l0*  px  <6> 

8 8 


Thus  the  two  basic  functions  for  the  binary  item  g of  the  constant 
Information  model  on  the  dichotomous  response  level  are  obtained  from 
(5.2),  (5.5),  (5.6)  and  (6.1) 


-2a  rP  (6S1/2[Q  (9)f1/2--2a  tan(a  (0  - b ) + u/4] 

o © o o o o 

(6.2)  (0)  < for  ug"  0 

8 l"  2aglQg(0>]1/2[Pg(e>f1/2  “ 2ag  cot(ag(0  - bg)  + tt/4) 

for  u ■ 1 
8 

It  is  clear  from  the  above  that  the  basic  function  for  u ■ 1 is  a 

8 

strictly  decreasing  function  of  6 with  positive  infinity  and  zero 
as  its  two  asymptotes,  and  that  for  ug  ■ 0 is  a strictly  decreasing 
function  of  6 with  zero  and  negative  infinity  as  its  two  asymptotes, 
respectively.  Figure  6-1  illustrates  a few  examples  of  these  basic 
functions  with  different  sets  of  item  parameters. 

The  item  response  information  function,  which  can  be  written  as 


(6.3) 


I (0) 

X8 


7e  Ax  <e> 

8 


I 


l.lMh  i . in  >'*  -1.0/08  0.107  1 0.952H 


umvT 


-0.7146 


0.8927 


2.0708 


II 

3.0472 

3.1416 


FIGURE  6-1 


Basic  Functions  of  Five  Items  Following  the  Constant  Information  Model, 
with  the  Parameters,  aj  - 0.25  and  bj  - 0.00  (Smaller  Dots),  a,  - 0.5 

and  b2  - 0.50  (Shorter  Dashes),  a^  - 0.75  and  b^  - 2.00  (Larger  Dots) 

*4  " 1,00  ttnd  b4  " -1.50  (Longer  Dashes)  and  a^  - 2.00  and  b,.  - 0.50 

(Solid  Curve),  for  u - 0 (Upper  Graph)  and  for  u - 1 (Lower  Graph). 


-30- 


on  the  graded  response  level,  is  found  to  be  for  each  of  the  two 
binary  response  categories  of  the  constant  information  model  on 
the  dichotomous  response  level 


(6.4) 


lu  (9) 

g 


{ 


2a  2 sec2[a  (0  - b ) + n/4] 
8 g 8 

2a  2 esc2 (a  (0  - b ) + n/4] 
g 8 8 


2a  2[Q  (O)r1  > 0 
8 g 


for 

[p  (e)r1 

8 


u ■ 0 
g 


for  u - 1 . 


g 

figure  6-2  illustrates  these  two  item  response  information  functions 

for  an  item  with  the  parameters,  a -0.25  and  b " 0,00  , together 

g g 

with  the  constant  item  information  function  (■  0.25).  From  (2.4)  and 

(6.4)  we  can  write  for  the  response  pattern  information  function 

(6.5)  W6)  - 2 E a2(P  (0)]  “g[Q  (0)]°*  1 , 

v u EV  8 8 8 

g 

and,  finally,  the  test  information  function  is  given  by 

n , 

(6.6)  1(0)  - 4 £ a Z . 

g-1  8 

Figure  6-3  presents  both  the  set  of  four  response  pattern  information 
functions  and  the  test  information  function  for  a hypothetical  test 
of  two  binary  items,  whose  item  parameters  are  a^  - 0.25,  b^  ■ 0.00, 

*2  ■ 0.50  and  b^  ■ 1.00  . 

The  present  model  can  be  expanded  to  the  one  in  the  homogeneous 
case  (Samajlma,  1972)  of  the  graded  response  level  easily,  although 
in  such  a case  it  cannot  be  called  constant  information  model. 

It  will  be  discussed  on  some  other  occasion,  however,  when  the 
necessity  has  come. 

We  have  seen  in  an  earlier  section  that  the  area  under  the 


curve  of  the  square  root  of  the  item  Information  is  the  same,  regardless 


-3.1416 


UffWT  VRMT  C 


3.1416 


FIGURE  6-2 

Item  Response  Information  Functions  of  an  Item  Following  the  Constant 
Information  Model,  with  the  Parameters,  a - 0.25  and  b ■ 0.00  , 

R g 

for  u • 0 (Dotted  Curve)  and  for  u ■ 1 (Solid  Curve) , Together 
® 8 
with  the  Constant  Item  Information  Function  (Dashed  Curve), 


l 


-0.5708 


TNSIT  • 


2.5708 


FIGURE  6-3 

Response  Pattern  Information  Functions  of  the  Four  Possible  Response 
Patterns,  (0,  0)  (Shorter  Dashes),  (0,  1)  (Smaller  Dots),  (1,  0) 
(Solid  Curve)  and  (1,  1)  (Larger  Dots),  of  IVo  Binary  Items 
Following  the  Constant  Information  Model  with  the 
Parameters,  at  - 0.25,  bx  - 0.00,  a2  - 0.50  and 

b2  ■ 1.00  . The  Test  Information  Function 
Is  Also  Given  by  Longer  Dashes. 
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of  Che  specific  model,  provided  that  it  belongs  to  the  present  type 
which  has  a strictly  increasing  item  characteristic  function  with  zero 
and  unity  as  its  two  asymptotes.  We  should  note,  however,  that  the 
important  index  is  the  reciprocal  of  the  square  root  of  the  test 
information  function,  which  is  considered  as  the  standard  error  of 
estimation  specified  as  a function  of  0 . For  this  reason, 
we  shall  make  some  observations  upon  the  area  under  the  curve  of 
the  reciprocal  of  the  square  root  of  the  item  information  function 
of  the  constant  information  model,  in  comparison  with  those  of  other 
models  of  the  same  type. 

It  can  be  seen  that,  if  the  range  of  6 is  the  set  of  all 
real  numbers,  then  the  asymptote  of  the  item  information  function 
when  0 approaches  either  positive  or  negative  infinity  should  be 
zero  regardless  of  the  specific  model  which  belongs  to  the  present 
type,  since  the  area  under  the  curve  of  the  item  information  function 
is  finite.  From  this  fact,  it  is  obvious  that  the  area  under  the 
curve  of  the  reciprocal  of  the  square  root  of  the  item  information 
function  is  positive  infinity,  since  the  function  tends  to  positive 
infinity  as  0 approaches  either  positive  or  negative  infinity. 

This  subset  of  models  includes  both  the  normal  ogive  and  logistic 
models.  We  can  say,  therefore,  that  the  accuracy  of  estimation  is 
low  on  the  average,  when  we  consider  the  whole  range  of  0 , even 
though  these  models  may  provide  a high  accuracy  of  estimation 
locally.  When  the  range  of  0 is  a finite  interval,  the  area  under 
the  curve  of  the  reciprocal  of  the  square  root  of  the  item  information 
function  can  be  finite,  and,  therefore,  the  accuracy  of  estimation 
can  be  higher  on  the  average,  when  we  consider  the  whole  range  of 
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0 . Following  a similar  mathematical  process  as  we  take  in  the 
proof  of  the  theorem  that  the  harmonic  mean  can  never  ba  graater 
than  the  arithmetic  mean  when  all  the  observations  are  positive, 
it  can  be  shown  that  the  area  under  the  curve  of  the  reciprocal  of 
the  square  root  of  the  item  information  function  is  minimal  for 


the  constant  information  model,  among  those  models  of  the  present 


type  which  have  the  same  interval  of  0 as  the  range  of  0 . It 
can  be  said,  therefore,  the  constant  information  model  has  the  best 
accuracy  of  estimation  on  the  average,  when  we  consider  the  whole 
range  of  0 . 

For  the  purpose  of  illustration,  Figure  6-4  presents  two  graphs, 
one  of  which  provides  us  with  the  square  root  of  the  item  information 
function  of  the  constant  information  model,  with  a^  - 1/4 

■ 0.25  and  b^  ■ 0.00  , and  that  for  another  model,  which  increases 
from  0.1  to  0.9  in  the  first  half  of  the  interval  of  9 and  then 
decreases  from  0.9  to  0.1  in  the  second  half.  It  is  obvious  that 
the  areas  under  these  two  curves  are  both  it  . The  other  graph 
in  Figure  6-4  presents  the  reciprocals  of  these  two  functions  in 
the  first  graph.  It  is  clear  that  the  area  under  the  curve  for  the 
constant  information  model  is  much  less  than  that  for  the  other  model. 
It  should  be  noted  that,  when  we  consider  the  corresponding  reciprocals 
of  the  square  roots  of  the  test  information  functions  for  the  set  of 
n equivalent  items  following  these  models,  the  configuration  in  the 
second  graph  Is  still  the  same,  with  all  the  ordinate  values  divided 
by  the  square  root  of  n . 
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LATENT  TRAIT  0 


LATENT  TRAIT  0 


FIGURE  6-4 

Square  Roots  of  the  Item  Information  Functions  of  the  Constant 
Information  Model  (Dotted  Curve)  and  Another  Model  (Solid  Curve), 
Which  Have  the  Same  Area,  Are  Shown  in  the  Upper  Graph,  While 
in  the  Lower  Graph  the  Reciprocals  of  the  Corresponding 
Functions  in  the  Upper  Graph  Are  Drawn.  The  Item 
Parameters  in  the  Constant  Information  Model  Are  : 

a ■ 0.25  and  b ■ 0.00  . 
g g 
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VII  Maximimum  Likelihood  Estimation  of  Ability  When  the  Set  of 

Binary  Items  Are  Equivalent  and  Follow  the  Constant  Information 
Model 

Suppose  all  the  n binary  items  in  a test  are  equivalent 
(Lord  and  Novick,  1968),  so  that  we  can  write 

(7.1)  P, (6)  - P,(0)  - - P (6)  - ...  - P (0)  . 

1 Z g n 

It  has  been  shown  that  in  this  situation  the  simple  test  score  t such 
that 

(7.2)  t - E u 

u eV  8 
g 

is  a minimal  sufficient  statistic,  regardless  of  the  model  that  the 
item  characteristic  functions  follow  (cf.  Birnbaum,  1968).  In 
connection  with  the  maximum  likelihood  estimation  of  the  examinee’s 
ability  or  latent  trait,  this  can  be  explained  as  follows. 

On  the  dichotomous  response  level,  (2. A)  can  be  rewritten 
as 

u 1— u 

(7.3)  P (6)  - n [P  (0)]  8[ Q (0)]  8 . 

u eV  8 8 

g 

Since  this  operating  characteristic  of  the  response  pattern  V itself 
is  the  likelihood  function  in  estimating  the  examinee's  ability,  we  are 
to  use  the  symbol  Ly(0)  for  this  function  in  the  present  section. 

When  all  the  items  are  equivalent,  we  can  rewrite  (7.3)  In  the  form 

(7.4)  LyO)  - p»^(0)]t  [Qg(0)f“ C . 

Thus  we  have  for  the  likelihood  equation 


logLyO)  Pg(0)  ][t  - nPg(0)](Pg(0)Qg(0)]"1  - 0 . 


(7.5) 
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It  should  be  noted  that,  although  we  used  the  operating  characteristic 
of  the  specific  response  pattern  as  the  likelihood  function,  on  the 
right  hand  side  of  (7.4)  the  response  pattern  V does  not  show  Itself, 
and  all  the  information  given  by  that  particular  response  pattern 
is  summarired  In  the  form  of  the  test  score  t . Thus  all  we  need 
in  the  estimation  process  is  this  simplified,  sufficient  statistic  t , 
instead  of  the  original  response  pattern  V . From  (7.3)  we  obtain 


(7.6) 


t - nPg(0)  , 


and  the  maximum  likelihood  estimate  0 is  given  by 


(7.7) 


6 - P_1(t/n)  . 

8 


When  this  common  item  charactrerist lc  function  follows  the 
constant  information  model,  we  obtain  from  (5.2)  and  (7.7) 


(7.8) 


fi  - a^  1 [sin  *(t/n)*^ 


tt/4]  + b . 
R 


It  is  obvious  from  (5.4)  and  (7.8)  that  the  range  of  P is  given  by 


[-TiaR"1/4]  + bg  * 6 * [nag_1/4]  + b? 


(7.9) 
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VIII  Katlmatlon  of  the  Operating  Characteristic  without  Using 
the  Old  Test 

It  has  been  mentioned  that  the  family  of  methods  and  approaches 
developed  for  estimating  the  operating  characteristics  of  item  response 
categories  (Samejlma,  1977b,  1977d,  1978a,  1978b,  1978c,  1978d,  1978e) 
preassumes  the  Old  Test,  or  a set  of  items  whose  operating  character- 
istics are  known  and  which  provides  us  with  a constant  test  Information 
function  over  the  range  of  8 of  our  interest.  In  this  section, 
we  are  to  see  how  these  methods  can  be  generalised  to  the  situation 
In  which  we  are  to  develop  a new  Item  pool,  and,  naturally,  cannot 
depend  upon  any  "Old  Test."  Suppose,  for  developing  the  new  Item 
pool,  a substantial  number  of  test  items  are  administered  to  a 
substantial  number  of  examinees,  and  there  exists  a subset  of  equivalent 
binary  items  among  these  items.  In  this  situation,  we  can  use  this 
subset  of  items  as  the  substitute  for  the  Old  Test. 

We  assume  that  these  equivalent  items  have  a strictly  increasing 
Item  characteristic  function  with  0 and  1 as  its  two  asymptotes. 

As  we  have  seen  In  previous  sections,  we  can  adjust  the  latent  trait 
scale  in  such  a way  that  the  resulting  common  item  characteristic 
function  for  these  equivalent  items  follow  the  constant  information 
model,  which  Is  given  by  (5.2).  Then  the  response  pattern  of  each 
examinee  with  respect  to  this  subset  of  equivalent  binary  items 
Is  specified,  and  is  summarized  In  the  form  of  test  score.  The  origin 
and  unit  of  the  latent  trait  are  set  more  or  less  arbitrarily,  say, 

a -0.25  and  b -0.00  . From  the  test  score  of  the  subset  of 
8 8 

equivalent  binary  items,  the  maximum  likelihood  estimate  of  the 
examinee's  ability  Is  obtained  through  (7.8).  The  resulting  set 


of  the  maximum  likelihood  estimates  for  all  the  examinees  can  be 
used  In  the  same  way  as  we  use  the  set  of  maximum  likelihood  estimates 
obtained  from  the  results  of  the  Old  Test.  The  operating  character- 
istics of  each  of  the  other  items  can  be  estimated  in  the  same  way  as 
we  do  when  we  use  the  Old  Test.  After  this  lias  been  done,  we  can 
transform  the  latent  trait  in  whatever  way  we  wish. 

In  using  the  generalized  method,  we  should  be  aware  of  a few 
problems.  First  of  all,  the  constant  test  information  provided  by 
the  subset  of  equivalent  binary  items  with  the  constant  information 

model  should  be  substantially  large,  so  that  the  normal  approximation 

/\ 

for  the  conditional  distribution  of  0 , given  0 , should  be 
acceptable.  On  the  other  hand,  we  need  a substantially  wide  range 
of  ability  0 for  which  the  test  information  is  constant,  in  order 
to  make  the  estimation  of  the  operating  characteristics  of  the  other 
items  meaningful.  These  two  are  opposing  factors,  as  is  obvious 
from  (5.3)  and  (5.4).  The  solution  for  this  problem  is  to  use  a 
substantially  large  number  of  equivalent  binary  1 1 ems , whose  common 
discrimination  parameter  is  low. 

A 

Another  problem  is  the  effect  of  the  range  of  0 on  the  speed 

A 

of  convergence  of  the  conditional  distribution  of  0 , given  0 , 

-1/2  ^ 

to  the  normal  distribution,  N(0,  (nC)  )•  Since  the  range  of  0 is 
a finite  interval  which  is  given  by  (7.9),  it  should  be  expected  that 
the  truncation  of  the  conditional  distribution  makes  the  convergence 
slow  around  the  values  of  0 close  to  (-■na”1/4)+b^  and  (na^/A)-^  , 
as  Is  illustrated  in  Figure  8-1.  We  must  turn  to  Monte  Carlo  studies 
to  Investigate  this  problem  further  and  in  more  detail,  which  will  be 


done  in  the  near  future.  A solution  for  this  problem  is  again  to  use  a 




LATENT  TRAIT  * 


FIGURE  8-1 

Graphical  Illustration  of  Che  Conditional  Density  Functions 

of  the  Maximum  Likelihood  Estimate  0 , Given  the  Latent 

Trait  0 . 
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set  of  equivalent  binary  Items  whose  common  discrimination  parameter 
is  low,  so  that  the  range  of  6 Is  wide  enough  to  Include  all  the 
examinees  far  inside  of  the  two  endpoints  of  the  Interval  of  0 . 

An  alternative  for  the  above  solution  is  to  exclude  examinees  whose 

0's  are  close  to  [-tra  /4]+b  or  [rra  /41+b  . In  the  second  solution, 

g 8 g g 

however,  the  number  of  examinees  will  be  decreased  and  this  may  affect 
the  accuracy  of  the  estimation  of  the  operating  characteristics. 

It  is  worth  noting  Chat  the  solution  for  the  first  problem,  which  is 
underscored  in  the  preceding  paragraph,  is  also  the  solution  for  the 
second  problem. 

If  there  exist  more  than  one  subset  of  equivalent  binary  items 
within  the  tentative  item  pool,  we  can  make  a full  use  of  all  the 
subsets.  We  follow  the  process  described  earlier  for  each  subset 
of  equivalent  binary  items,  and  the  resultant  estimated  operating 
characteristics  can  be  equated  by  appropriate  transformations  of  the 
separately  defined  latent  traits,  using,  say,  the  least  squares 
principle,  to  integrate  all  of  them  into  one  scale. 
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IX  How  to  Detect  a Subset  of  Equivalent  Binary  Items 

A natural  question  is  how  to  detect  a subset  of  equivalent 
binary  items  out  of  the  tentative  item  pool.  In  empirical  sciences, 
it  is  often  difficult  to  obtain  a sufficient  evidence.  The  second 
best  way  will  be,  therefore,  to  formulate  a set  of  necessary  evidences, 
and  to  check  our  data  with  respect  to  each  criterion.  If  we  find 
out  that  our  data  satisfy  all  the  necessary  conditions  thus  formulated, 
then  we  can  assume  that  we  have  obtained  what  we  wanted,  until  another 
necessary  criterion  becomes  available  and  our  data  contradict  it. 

In  our  situation,  first  of  all,  it  is  necessary,  though  not 

sufficient,  that  the  proportions  correct  should  be  the  same  value 

for  all  the  equivalent  binary  items,  within  the  range  of  sampling 

fluctuations.  This  can  be  checked  easily,  and  we  can  find  out  a group 

of  binary  items  which  satisfy  this  condition,  if  there  is  any.  Next, 

it  is  necessary  that  the  2x2  contingency  tables  of  the  bivariate 

frequency  distributions  should  be  symmetric  and  Identical  among  all 

the  pairs  of  equivalent  binary  items,  within  the  range  of  sampling 

fluctuations.  This  can  be  checked  for  every  pair  of  binary  items 

which  have  passed  the  first  selection,  and,  possibly,  some  items  have 

3 

to  be  dropped.  We  can  go  ahead  to  the  2 contingency  tables  after 
4 

this  step,  to  the  2 contingency  tables,  etc.,  if  we  wish. 

As  was  pointed  out  in  the  preceding  section,  it  is  desirable  that 
these  equivalent  items  have  a low  common  discrimination  power,  in  addition 
to  being  substantial  in  number.  A necessary  condition  for  this  is  that 
the  two  frequencies  for  the  response  patterns  (0,1)  and  (1,0),  which 
are,  theoretically,  the  same  value  if  the  two  items  are  equivalent, 
should  be  large,  or  compatible  to  the  other  two.  This  can  be  checked 


I 
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therefore,  in  the  same  process  for  checking  the  equivalency  of  the 
binary  items.  Figure  9-1  Illustrates  two  typical  2x2  contingency 
tables,  one  of  which  is  for  a pair  of  equivalent  binary  Items  which 
have  a common  low  discrimination  parameter,  and  the  other  is  for  a 
pair  of  those  which  have  a common  high  discrimination  parameter. 

The  above  are  Just  several  examples  of  the  necessary  conditions. 

It  is  desirable  that  researchers  work  on  this  problem  and  eventually  pro- 
duce an  appropriate  set  of  necessary  conditions  which  contains  more 
varieties  of  conditions  and  yet  is  useful  from  the  practical  point 
of  view  also. 


j 
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Low  Discrimination  Parameter 
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High  Discrimination  Parameter 
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53 
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FIGURE  9-1 

Two  Typical  2x2  Contingency  Tables  for  a Pair  of 
Equivalent  Items  with  a Common  Low  Discrimination 
Parameter,  and  for  Those  with  a Common  High 
Discrimination  Parameter,  Respectively 
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X Discussion  and  Conclusions 


It  has  been  pointed  out  that  the  area  under  the  square  root 
of  the  item  information  function  is  a constant  value,  it  , for  any 
strictly  increasing  item  characteristic  function  having  zero  and 
unity  as  its  two  asymptotes.  The  item  characteristic  function  of 
this  type,  which  provides  a constant  item  information  function,  has  been 
searched  and  discovered,  and  the  model  is  named  constant  information 
model.  It  has  been  observed  that  the  amount  of  information,  which 
such  a binary  item  provides  for  a specified  value  of  ability  0 , 
and  the  range  of  6 , for  which  the  item  has  a constant  information, 

have  a "trading  off"  relationship.  The  characteristics  ot  the  new 
model,  such  as  the  basic  function,  the  item  response  information 
function,  the  response  pattern  information  function,  etc.,  have 
been  investigated.  The  process  of  obtaining  the  maximum  likelihood 
estimate  of  the  examinee's  ability  or  latent  trait  when  the  n items 
are  binary  and  equivalent  has  been  shown,  using  the  constant  information 
model  and  the  sufficient  statistic,  t , i.e.,  the  simple  test  score. 

It  has  been  shown  that,  in  the  methods  and  approaches  of  estimating 
the  operating  characteristics  of  item  response  categories,  which 
have  been  introduced  earlier,  a set  of  equivalent  binary  items  in  the 
tentative  item  pool  can  be  used  as  a substitute  for  the  Old  Test,  and, 
therefore,  those  methods  are  usable  even  in  the  situation  where  we 
start  from  the  very  beginning  of  developing  an  item  pool  without  the 
Old  Test.  In  so  doing,  attention  has  been  called  upon  some  problems 
and,  for  them,  possible  solutions  have  been  suggested.  Some  practical 
considerations  as  to  how  we  can  detect  a subset  of  equivalent  items  out 
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of  all  the  binary  Items  In  the  tentative  Item  pool.  If  there  is  any, 
have  been  given. 

It  is  Interesting  to  note  that,  for  once,  items  with  low 
discrimination  power  have  an  important  role,  in  preference  to  those 
with  high  discrimination  power,  which  are  usually  considered  to  be 
better  items.  This  fact  leads  to  a more  general  conviction,  which 
is  related  with  the  attenuation  paradox  (Tucker,  1946,  Loevlnger, 

1954).  The  important  point  is  to  distinguish  two  different  situations, 

l.e.,  1)  the  situation  in  which  the  local  accuracy  of  estimation  by  an 
item  at  a certain  level  of  ability  or  latent  trait  is  important,  and 
2)  the-  one  in  which  the  overall  accuracy  of  estimation  by  an  item 
for  a certain  Interval  of  ability  or  latent  trait  is  Important.  As 
an  example  of  the  first  situation,  we  can  name  tailored  testing,  or 
the  computerized  adaptive  testing,  and  in  such  an  occasion  binary  items 
with  high  discrimination  power  are  more  useful.  The  second  situation 
is  exemplified  by  the  estimation  of  the  operating  characteristics 
of  graded  item  response  categories,  which  has  been  pursued  and  developed 
without  assuming  any  mathematical  forms  for  the  operating  characteristics. 
In  this  situation,  items  with  high  discrimination  power  are  not  necessarily 
useful,  and,  as  we  have  seen  in  the  preceding  sections,  low  discrimination 
items  are  more  useful  if  we  use  a subset  of  equivalent  binary  items 
in  the  tentative  item  pool  as  a substitute  for  the  Old  Test. 

It  has  been  pointed  out  earlier  (Samejlma,  1969,  Chapter  2)  that 
there  is  a philosophical  difficulty  in  determining  which  scale  of  latent 
trait  is  the  best  one  out  of  those  which  are  strictly  increasing 
transformations  of  one  another.  Rescaling  of  the  latent  trait  on  the 


■; 
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final  stage  of  the  generalized  methods  and  approaches  of  estimating 
the  operating  characteristics  of  graded  item  response  categories, 
therefore,  may  have  to  depend  solely  upon  convenience. 


I 
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A-I  Simulated  Data 

The  simulated  data  used  In  the  present  study  are  characterized 
as  follows. 

(1)  There  are  500  hypothetical  examinees. 

(2)  Their  ability,  or  latent  trait,  distributes  uniformly  for  the 

interval  of  9 , (-2.5,  2.5).  Actually,  we  use  100  discrete 

points  of  9 , such  as  -2.475,  -2.425,  -2.375,  -2.325,  

2.375,  2.425  and  2.475,  i.e.,  the  midpoints  of  the  100  subintervals 
with  the  width  of  0.05,  and  at  each  point  five  examinees  are 
located. 

(3)  There  is  a hypothetical  test  of  35  graded  items,  each  of  which 
has  four  item  score  categories,  and  which  provides  us  with  an 
approximately  constant  test  information  function,  21.63,  for 

the  interval  of  9 , [-3.0,  3.0],  following  the  normal  ogive 

model  of  the  graded  response  level  (Samejima,  1969,  1972).  The 
test  is  called  the  Old  Test,  to  distinguish  from  the  New  Test, 
which  will  be  described  later. 

(4)  Each  of  the  500  examinees  is  assumed  to  have  taken  the  Old 
Test,  and  his  response  pattern  on  the  35  graded  items  has  been 
calibrated  by  the  Monte  Carlo  method.  The  score  categories  of 
each  item  are  0,  1,  2 and  3,  and  a typical  response  pattern 
looks  like:  (3, 3, 3, 2, 3, 3, 2, 2, 2, 2, 2, 2, 1,2, 2, 2, 1,2, 1,1, 1,0, 1,1, 

1,0, 1,0, 1,1, 0,0, 0,0,0). 

(5)  From  each  response  pattern,  the  maximum  likelihood  estimate  of  the 
examinee's  ability  has  been  obtained,  using  a computer  program 
written  for  this  purpose.  In  this  process,  out  of  140  basic 
functions  (Samejima,  1969,  1972),  an  appropriate  set  of  35  basic 
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functions  are  chosen  depending  upon  the  item  scores  in  the 
response  pattern,  and,  using  the  Newton-  Raphson  procedure, 
the  point  of  0 at  which  the  sum  total  of  these  35  basic 
functions  equals  zero  is  searched. 

(6)  There  is  another  hypothetical  test  of  10  binary  items,  each 
of  which  follows  the  normal  ogive  model  of  the  dichotomous 
response  level.  This  is  called  the  New  Test. 

(7)  Each  of  the  500  examinees  is  assumed  to  have  taken  the  New 
Test  also,  and  his  response  pattern  on  the  New  Test  has  been 
calibrated  by  the  Monte  Carlo  method.  A typical  response 
pattern  looks  like:  (0,0, 0,1, 0,0, 1,0, 1,1) . 

(8)  The  item  characteristic  functions  of  the  test  items  of  the 
New  Test  are  assumed  to  be  unknown,  and  they  are  the  target 

of  estimation.  Each  method  of  estimation  is  evaluated  by  the 
the  "closeness"  of  the  resultant  estimated  item  characteristic 
functions  to  the  true  item  characteristic  functions. 
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1 Dr.  Gary  Marco 

Educational  Testing  Service 
Princeton,  NJ  08450 

1 Dr.  Scott  Maxwell 

Department  of  Psychology 
University  of  Houston 
Houston,  TX  77025 

1 Dr.  Sam  Mayo 

Loyola  University  of  Chicago 
Chicago,  IL  60601 

1 Dr.  Allen  Munro 

Univ.  of  So.  California 
Behavioral  Technology  Labs 
3717  South  Hope  Street 
Los  Angeles,  CA  90007 

1 Dr.  Melvin  R.  Novick 
Iowa  Testing  Programs 
University  of  Iowa 
Iowa  City,  IA  52242 

1 Dr.  Jesse  Orlansky 

Institute  for  Defense  Analysis 
400  Army  Navy  Drive 
Arlington,  VA  22202 

1 Dr.  James  A.  Paulson 

Portland  State  University 
P.0.  Box  751 
Portland,  OR  97207 

1 MR.  LUIGI  PETRULL0 

2431  N.  EDGEWOOD  STREET 
ARLINGTON,  VA  22207 

1 DR.  STEVEN  M.  PINE 
4950  Douglas  Avenue 
Golden  Valley,  MN  55416 
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Non  Govt 


Non  Govt 


DR.  DIANE  M.  RAMSEY-KLEE 
R-K  RESEARCH  & SYSTEM  DESIGN 
39**7  RIDGEMONT  DRIVE 
MALIBU,  CA  90265 

MIN.  RET.  M.  RAUCH 
P II  4 

BUNDESMINISTERIUM  DER  VERTEIDIGUNG 
POSTFACH  161 
53  BONN  1,  GERMANY 

Dr.  Peter  B.  Read 
Social  Science  Research  Council 
605  Third  Avenue 
New  York,  NY  10016 

Dr.  Mark  D.  Reckase 
Educational  Psychology  Dept. 
University  of  Missouri-Columbia 
12  Hill  Hall 
Coluobia,  MO  65201 

Dr.  Fred  Re  if 
SESAME 

c/o  Physics  Department 
University  of  California 
Berkely,  CA  94720 

Dr.  Andrew  M.  Rose 
American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NW 
Washington,  DC  20007 

Dr.  Leonard  L.  Rosenbaum,  Chairman 
Department  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

Dr.  Ernst  2.  Rothkopf 
Bell  Laboratories 
600  Mountain  Avenue 
Murray  Hill,  NJ  07974 

Dr.  Donald  Rubin 
Educational  Testing  Service 
Princeton,  NJ  08450 


1 Dr.  Larry  Rudner 
Gallaudet  College 
Kendall  Green 
Washington,  DC  20002 

1 Dr.  J.  Ryan 

Department  of  Education 
University  of  South  Carolina 
Columbia,  SC  29208 

1 PROF.  FUMIK0  SAMEJIMA 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  TENNESSEE 
KNOXVILLE,  TN  37916 

1 DR.  ROBERT  J.  SEIDEL 

INSTRUCTIONAL  TECHNOLOGY  GROUP 
HUMRR0 

300  N.  WASHINGTON  ST. 

ALEXANDRIA,  VA  22314 

1 Dr.  Kazao  Shigemasu 
University  of  Tohoku 
Department  of  Educational  Psychology 
Kawauchi,  Sendai  98 2 
JAPAN 

1 Dr.  Edwin  Shirkey 

Department  of  Psychology 
Florida  Technological  University 
Orlando,  FL  32816 

1 Dr.  Richard  Snow 
School  of  Education 
Stanford  University 
Stanford,  CA  94305 

1 Dr.  Robert  Sternberg 
Dept,  of  Psychology 
Yale  University 
Box  11A,  Yale  Station 
New  Haven,  CT  06520 

1 DR.  ALPERT  STEVENS 

BOLT  BERANEK  4 NEWMAN,  INC. 

50  MOULTON  STREET 
CAMBRIDGE,  MA  02138 
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DR.  PATRICK  SUPPES 

INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 

Dr.  Hariharan  Swaminathan 
Laboratory  of  Psychometric  and 
Evaluation  Research 
School  of  Education 
University  of  Massachusetts 
Amherst,  MA  01003 

Dr.  Brad  Sympson 
Elliott  Hall 
University  of  Minnesota 
75  E.  River  Road 
Minneapolis,  MN  55455 

Dr.  Kikumi  Tatsuoka 
Computer  Based  Education  Research 
Laboratory 

252  Engineering  Research  Laboratory 
University  of  Illinois 
Urbana,  IL  61801 

Dr.  David  Thissen 
Department  of  Psychology 
University  of  Kansas 
Lawrence , KS  66044 

Dr.  J.  Uhlaner 
Perceptronics,  Inc. 

6271  Variel  Avenue 
Woodland  Hills,  CA  91364 

Dr.  Howard  Wainer 

Bureau  of  Social  SCience  Research 

1990  M Street,  N.  W. 

Washington,  DC  20036 

DR.  THOMAS  WALLSTEN 
PSYCHOMETRIC  LABORATORY 
DAVIE  HALL  013A 
UNIVERSITY  OF  NORTH  CAROL 
CHAPEL  HILL,  NC  27514 


Non  Govt 


1 Dr.  John  Wannous 

Department  of  Management 
Michigan  University 
East  Lansing,  MI  48824 

1 DR.  SUSAN  E.  WHITELY 
PSYCHOLOGY  DEPARTMENT 
UNIVERSITY  OF  KANSAS 
LAWRENCE,  KANSAS  66044 

1 Dr.  Wolfgang  Wildgrube 
Streitkraefteamt 
Rosenberg  5300 
Bonn,  West  Germany  D-5300 

1 Dr.  Robert  Woud 

School  Examination  Department 

University  of  London 

66-72  Gower  Street 

London  WCIE  6EE 

ENGLAND 

1 Dr.  Karl  Zinn 

Center  for  research  on  Learning 
and  Teaching 
University  of  Michigan 
Ann  Arbor,  MI  48104 
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Navy 

J Donald  Cnldcr 

Office  of  Naval  Research 
325  Hinman  Research  Building 
Atlanta,  GA  30332 


Non  Govt 

1 Mr.  George  Woods 
1106  Newport  Avenue 
Victoria,  B.C. 

V8S  5E4  CANADA 

1 Dr.  P.  Mengal 

Faculte'  de  Psychologle 
Universite'  de  Geneve 
3 fl.  de  r'universite 

1201  Geneva,  SWITZERLAND 

1 Dr.  Wm.  J.  van  der  Linden 
Vakgroep  Onderwisjskunde 

Postbus  217 
7500  EA  Enschede 

THE  NETHERLANDS 


Army 


1 Dr.  Randall  M.  Chambers,  Ph.D. 
U.S.  Army  Research  Institute 
for  the  Behavioral  and  Social 
Sciences 

Fort  Sill  Field  Unit 

P.O.Box  3066 

Fort  Sill,  OK  73503 
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